Search results for " sonification"

showing 3 items of 3 documents

Quantum GestART: Identifying and Applying Correlations between Mathematics, Art, and Perceptual Organization

2020

Mathematics can help analyze the arts and inspire new artwork. Mathematics can also help make transformations from one artistic medium to another, considering exceptions and choices, as well as artists' individual and unique contributions. We propose a method based on diagrammatic thinking and quantum formalism. We exploit decompositions of complex forms into a set of simple shapes, discretization of complex images, and Dirac notation, imagining a world of "prototypes" that can be connected to obtain a fine or coarse-graining approximation of a given visual image. Visual prototypes are exchanged with auditory ones, and the information (position, size) characterizing visual prototypes is con…

FOS: Computer and information sciencesdiagrams; Dirac notation; Gestalt; Gestural similarity; sonificationmedia_common.quotation_subjectHistory and Overview (math.HO)ComputerApplications_COMPUTERSINOTHERSYSTEMSThe artsGestaltBra–ket notationPerceptionGestural similarityFOS: MathematicssonificationQuantummedia_commonCognitive scienceSettore INF/01 - InformaticaMathematics - History and OverviewApplied MathematicsSettore MAT/04 - Matematiche ComplementariMultimedia (cs.MM)Gestural similarity Gestalt diagrams Dirac notation sonificationComputational MathematicsdiagramsSonificationModeling and SimulationGestalt psychologyDirac notationInformationSystems_MISCELLANEOUSSettore ING-INF/05 - Sistemi di Elaborazione delle InformazioniComputer Science - MultimediaMusic
researchProduct

Interaction by ear

2019

Abstract Speech-based interaction is now part of our everyday experiences, in the home and on the move. More subtle is the presence of designed non-speech sounds in human-machine interactions, and far less evident is their importance to create aural affordances and to support human actions. However, new application areas for interactive sound, beyond the domains of speech and music, have been emerging. These range from tele-operation and way-finding, to peripheral process monitoring and augmented environments. Beyond signalling location, presence, and states, future sounding artifacts are expected to be plastic and reconfigurable, and take into account the inherently egocentric nature of so…

Settore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniAuditory displaySonificationSettore INF/01 - InformaticaSonic information designProcess (engineering)Computer scienceGeneral EngineeringRepresentation (systemics)Human Factors and ErgonomicsInteraction designSonic interaction design Sonic information design Sonification Auditory displayEducationHuman-Computer InteractionHardware and ArchitectureHuman–computer interactionSonic interaction designAffordanceSoftware
researchProduct

The Sound of Swarm. Auditory Description of Swarm Robotic Movements

2023

Movements of robots in a swarm can be mapped to sounds, highlighting the group behavior through the coordinated and simultaneous variations of musical parameters across time. The vice versa is also possible: sound parameters can be mapped to robotic motion parameters, giving instructions through sound. In this article, we first develop a theoretical framework to relate musical parameters such as pitch, timbre, loudness, and articulation (for each time) with robotic parameters such as position, identity, motor status, and sensor status. We propose a definition of musical spaces as Hilbert spaces, and musical paths between parameters as elements of bigroupoids, generalizing existing conceptio…

Swarm robotics quantum computing sonificationSettore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniHuman-Computer InteractionArtificial IntelligenceACM Transactions on Human-Robot Interaction
researchProduct